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ASPECTS  OF  VISUAL  SEARCH  ACTIVITY  RELATED  TO 
ATTENTIONAL  PROCESSES  AND  SKILL  DEVELOPMENT 

I  GOAL  OF  PERFORMED  RESEARCH 

We  have  in  previous  research  noted  a  number  of  measures  of  oculomotor  . 
activity  which  varied  consistently  ae  a  function  of  accumulated  fatigue. 

Such  ahangee  can  be  observed  both  in  laboratory-baaed  experimental  tasks  and 
in  field  situations.  It  is  our  impression  that  these  alterations  in  oculo¬ 
motor  aotivity  correspond  to  periods  of  decreased  adequacy  in  task  performance. 
Our  primary  goal  in  the  present  research  has  been  to  identify  both  momentary 
and  tonic  changes  in  alertness  using  oculomotor  measures  and  to  relate  the 
eye  movement-indexed  periods  of  altered  state  to  changes  In  performance. 

Intermediate  goals  included  the  selection  and  development  of  a  task 
suited  to  the  experimental  question  and  evaluation  of  several  alternative 
measures  of  oculomotor  function.  The  task  selected  had  to  be  one  which 
imposed  a  reasonable  workload  on  the  subfleot  in  order  to  develop  a  fatigue- 
like  condition  within  a  relatively  brief  period.  If  had  to  allow  freedom 
of  eye  movement  so  that  measures  would  be  readily  available.  It  was  further 
desirable  that  the  task  provide  a  moment-to-aoment  measure  of  performance 
adequacy  since  our  concern  is  with  phasic  as  well  as  tonic  alterations  in 
state  and  behavior. 

II  GENERAL  INTRODUCTION 

A.  General  perspective 

The  oculomotor  control  system  is  exquisitely  sensitive  to  fatigue 
and  attentional  parameters.  As  a  finely  tuned  mechanical  system,  the  ooulo- 
motor  system  is  subjeot  to  disruption  from  real  or  incipient  breakdown  of 
cortical  oontrol.  Such  breakdown  may  be  due  to  fatigue,  boredom,  lapses  In 
attention,  or  physiological  or  pharmacological  disruption  of  CNS  function. 
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Aa  a  highly  coordinated  syattm  of  Information  Intake ,  the  ooulomotor  ayatem 
refleota  the  efficiency  of  processing  whloh  Is  affected  both  by  Immediate 
Information  processing  demands  and  by  the  total  workload  experienced  by  the 
operator.  The  overall  coordination  of  various  aspects  of  ooular  activity 

* 

depends  on  the  task,  the  capability  of  the  individual  performing  the  task, 
and  the  ourrent  state  (or  capacity)  of  the  individual.  As  a  primary  channel 
for  information  acquisition,  the  oculomotor  system  mirrors  the  attentional 
and  processing  strategies  of  the  operator.  Eye  movement  and  blink  responses 
serve  on  some  occasions  to  block  additional  input  and  on  other  oooaslons, 
to  facilitate  input  of  speolflc  information. 

Flying  an  airplane  is  a  visual  taski  it  involves  making  oriticil 
decisions  based  on  visull  information.  The  eye,  and  the  associated  ooulo¬ 
motor  control,  is  the  sensing  system  for  taking  in  such  information.  It 
seems  inherently  obvious  then  that  it  would  be  profitable  to  monitor  ocular 
aotivlty  in  an  operational  setting.  Analysis  and  evaluation  of  this  activity 
allow  inferences  concerning  the  adoquacy  of  an  operator's  visual  search  activ¬ 
ity  and  about  state  dependent  alterations  in  the  ability  to  input  and  process 
visual  information. 

Sinae  the  oculomotor  system  is  sensitive  to  variations  in  alertness, 
eye  movement  analysis  can  be  used  to  index  both  momentary  (phaslo)  and  tonic 
ohanges  in  alertness  and  attention.  Momentary  changes  have  been  identified 
i*  performance  "blocking"  (Bills,  1937)  and  as  performance  "lapses"  or  periods 
of  "micro-sleep"  (e.g.,  Williams,  1967).  Behavioral  indlednts  of  phasic 
drops  in  alertness  include  missed  stimuli,  occasional  failures  to  respond  to 
eues,  and  eplsodlo  degradation  in  general  performance.  Tonio  changes  are 
more  analogous  to  the  alterations  labelled  "fatigue",  "boredom",  or  overload. 
Behavlorally,  these  are  lndexad  by  elevated  thresholds,  increased  response 
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tinea,  and  perhaps  most  importantly,  an  increased  likelihood  of  phasic  drop¬ 
outs. 

Both  adequacy  of  visual  search  in  the  alert  pilot  and  change  in  the 
state  of  alertness  affect  performance.  Most  pa*t  studies  of  ocular  activity 
have  focused  on  eye  position,  and  much  progress  has  been  made  in  accurately 
determining  where  the  eye  is  directed.  Comparatively  little  effort  has  been 
devoted  to  studying  the  nature  of  the  eye  blink  aud  eye  movements ,  aspeots  of 
which  can  tell  us  a  great  deal  about  changes  of  state  which  oritioally  influ¬ 
ence  performance.  Eveh  less  work  has  been  devoted  to  relating  eyo  movements 
to  adequacy  of  decision-making  and  motor  responses  in  complex  task  perform¬ 
ance  such  as  piloting  an  airplane  or  scanning  a  radar  display.  Because  of 
the  intimate  Influence  of  state  variation  on  eye  movement  parameters,  it  is 
the  later,  relatively  unexplored  areas,  which  are  most  likely  to  yield  useful 
measures  and  predictive  tools.  A  number  of  measures  which  have  been  Shown 
to  be  sensitive  to  time  on  task  and  pharmacological  manipulation  are  available. 
Some  of  these  are  reviewed  below. 

B.  Parameters  of  blinks  and  eye  movements  as  indicants  of  alertness. 

Much  of  our  previous  research  has  Involved  the  use  of  eye  movement 
measures  to  Investigate  Information  processing  strategies.  Tasks  have  ranged 
from  tightly  controlled  and  circumscribed  laboratory  tasks,  to  reading  and 
simulated  automobile  driving,  as  well  as  on-the-road  driving  and  helicopter 
piloting.  Independent  variables  have  ranged  from  skill  or  training  level  to 
pharmacological  agents,  such  as  aloohol  and  minor  tranquilisers.  We  have 
become  Increasingly  impressed  with  the  effeots  of  cumulative  tlme-on-task 
and  the  subject’s  alertness  level  on  eye  movement  measures.  Our  own  experience 
and  recent  research  by  others  suggests  several  measurable  eye  movement  parameters 
which  are  informative  about  an  individual's  state  of  fatigue,  alertness,  or 
attention.  The  specific  utility  of  several  of  these  Is  elaborated  below. 
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They  include) 

1.  Eyeblink  oloiure  duration 

2.  Eyublink  patterning  (timing) 

3 .  Blink-associated  aaocadea 

4.  Fixation  duration 

5 .  Baccade  amplitude,  velocity,  and  their  interrelationahip 

1.  Eyeblink  cloture  duration 

Much  of  the  literature  dealing  with  the  evaluation  of  eyeblinka  hae 
been  ably  reviewed  and  criticised  by  Hall  and  Cusack  (1972)  •  They  point  out 
that  ooncluaions  were  often  baaed  on  email  sample  else  and  on  aamplea  oolleoted 
under  conditions  in  which  the  subject  could  not  have  been  expected  to  be  adapted 
to  the  experimental  situation.  In  addition,  results  have  often  been  contradict¬ 
ory.  Baaed  on.  large  aamplea  of  blinke  recorded  from  various  populationa  and 
over  several  laboratory  sessions,  ve  have  developed  a  reliable  eyeblink 
analysis  system,  Our  approach  to  blink  evaluation  leads  to  the  abstraction 
of  sevoral  descriptive  parameters One  of  these,  blink  closure  duration,  is 
sensitive  to  the  variables  of  present  Interest. 

Ve  have  found  that  closure  duration,  the  time  the  eye  remains  closed 
during  blinking,  is  associated  with  changes  in  alertness.  The  normal  eyeblink 
is  a  crisp,  rapid  movement..  The  eye  begins  to  open  as  soon  as  full  lid  closure 
is  achieved.  Occasional  blinks  are  markedly  longer  in  duration,  they  have 
longer  dosing  end/or  reopening  time*.  A  graphical  comparison  of  these  two 
forme  of  blink  is  presented  in  Figure  1, 

Early  observations  (Kopriva,  Horvath  h  Stern,  1971)  indicated  that  these 
long  closure  duration  blinks  occurred  more  often  after  subjects  had  recovered 
(clinically)  from  the  effects  of  a  short-acting  barbiturate  then  following  a 
control  period.  These  blinks  were  interspersed  with  other  "normal"  blinks. 

•*-  r 
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Figure  l,  Scoring  Eyeblinka,  A  typical  blink  (a),  end  long  . closure  duration  blink 
(b)  t*k«n  from  early  end  lute  in  *n  experimental  seeeion  for  ths  same  eubject  ere 
shown  in  upper  portion  of  the  figure.  Ths  lower  portion  is  s  schematised  blink 
illustrating!  c)  amplitude,  d)  half  amplitude,  e)  the  amplitude  defining  the  20% 
window,  f)  half  closure  duration,  and  g)  20%  window  duration. 
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What  varied  as  a  function  of  condition  was  not  the  form  of  the  typical  blink, 
but  rather  the  frequency  of  occurrence  of  atypical  blihke .  In  subsequent 
studies  ve  have  demonstrated  similar  significant  increases  in  the  incidence 
of  long  closure  duration  blinks  for  other  CNS  depresuants  (e.g.,  alcohol)  and 
as  a  function  of  time  on  task  (e.g,,  ko  minutes  of  automobile  simulator 
driving).  The  intoxicated  subject  (BAC  75  mga)t)  demonstrated  more  long 
closure  durations  and  a  more  rapid  development  of  sueh  "abnormal"  blinks  as  a 
function  of  time  on  tank. 

Our  current  procedure  for  detecting  long  closure  duration  blinks  is 
illustrated  in  Figure  1.  Basically,  it  consists  of  establishing  an  amplitude 
window  defined  as  a  proportion  of  total  blink  amplitude.  The  amount  of  time 
that  the  amplitude  exceeds  this  window  value  is  defined  as  the  closure  duration 
for  that  window,  In  preliminary  work  using  a  react ion-time  task,  ve  observed, 
consistent  with  previous  results,  an  increase  in  the  incidence  of  long  olosure 
duration  blinks  across  a  one-hour  experimental  session.  Although  this  is  true 
regardless  of  the  window  criterion  else,  the  effect  is  more  striking  for  small 
windows,  l.e.,  those  encompassing  the  time  within  25 %  of  maximal  olosure.  Using 
the  20X  window,  for  example,  ve  find  that  only  about  IK  to  12jt  of  all  blinks 
during  the  Initial  5  minutes  of  task  performance  exceed  an  arbitrarily  estab¬ 
lished  cut-off  criterion  of  100  msec.  Midway  through  the  hour,  3H  to  25%  of 
the  blinks  exceed  the  criterion.  During  the  final  five  minutes  of  task  per¬ 
formance,  the  range  increased  so  that  2%-5%%  of  all  blinks  satisfied  this 
criterion  for  long  closure  duration.  Having  found  the  incidence  of  long 
closure  duration  blinks  associated  with  time  on  task  and  decline  in  alertness, 
ve  suspect  that  the  occurrence  of  suoh  blinks  is  associated  with  drop-outs  in 
performance— not  only  on  tasks  demonstrating  the  processing  of  visual  inform¬ 
ation,  but  on  other  types  of  information  processing  tasks  as  well. 


I  **»•■!>  . 
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There  is  presently  no  systematic  data  on  changes  In  median  closure 
duration  with  decreasing  alertness.  Previous  research  has  focused  on  vhat 
Hall  and  Cusack  call  "blinking  blackout",  the  period  during  vhioh  the  viewer 
is  presumed  to  see  nothing.  This  period  is  not  synonymous  with  but  includes 

e 

the  time  during  which  the  eyes  are  dosed.  Blinking  blackout  has  been  estimated 
by  presenting  visual  stimuli  at  various  points  during  the  blink  and  determining 
acauracy  of  perception.  Information  on  the  duration  of  such  blackouts  is 
surprisingly  sparse.  The  most  recent  published  estimate  ve  could  find  (Vblkman, 
Riggs,  &  Moore,  1980)  is  200  msec.  Our  investigations  into  the  visual  suppression 
associated  with  blinking  suggest  that  this  estimate  is  too  high.  The  direct 


sment  of  blink  suppression  requires  specialized  procedures  somewhat  removed 


from  the  tasks  presumed  to  effect  blinking  duration.  We  have  elected,  therefore, 
to  make  the  assumption  that  the  blinking  period  is  directly  related  to  closure 
duration  and  to  measure  median  closure  duration  directly.  Regardless  of  window 
size,  the  general  effect  of  time-on-task  and  related  state  variables  is  toward 
small  increases  in  median  duration.  Although  the  differences  are  in  the  expected 
direction,  they  are  typically  so  small  and  variable  as  to  fall  to  make  any 
significant  contribution  to  total  task  performance.  For  example,  in  mhny  tasks, 
variation  in  20%  window  duration  from  early  to  late  in  the  session  is  between 
>2  and  1?  msec,  with  a  median  increase  of  only  2  msec.  Even  with  50  blinks  in 
a  five-minute  period  the  suppression  is  equivalent  to  only  .1  sec  of  lost  viewing 
time . 

Of  greater  Import  to  adequate  processing  in  a  visual  task  than  the  time 
lost  to  blinking  is  eye  closures  which  are  not  blinks.  After  cumulative  exper¬ 
ience  with  data  reduction  of  large  samples  of  blinks,  ve  have  concluded  that 
full  closure  durations  in  exoess  of  150  mseo  do  not  represent  blinking.  Our 
computerized  abstraction  procedures  were,  for  that  reason,  designed  to  eliminate 
from  analysis  any  closure  not  followed  within  150  msec  by  reopening.  Since  the 


I 
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viewer  cannot  input  visual  information  with  his  eyes  closed,  these  eye  closures 
reflect  either  inadvertent  or  self-imposed  "time-out"  from  input.  It  is  our 
impression  that  the  likelihood  of  these  eye  closures  increases  vith  time  on 
task.  They  may  he  associated  vith  performance  errors  and  missed  stimuli* 
especially  in  vigilance  tasks.  Our  analysis  routines  have  been  rewritten  to* 
allow  the  identification  of  such  alosures  from  eye  movement  recordings. 

2.  Eyoblink  patterning  (timing) 

Previous  attempts  to  index  visual  fatigue  using  the  blink  have 
foaused  on  blink  rate*  but  interpretations  of  this  measure  are  ambiguous. 
Luckiesh  and  Moss  (19^2)  proposed  blink  rate  as  an  adequate  measure  of  visual 
fatigue  in  reading  and  suggested  its  usefulness  in  other  tasks,  Their  results 
vers,  however*  vigorously  attacked.  Carmichael  and  Dearborn  (19^7)  reviewed 
the  use  of  blink  rate  and  concluded  that  it  was  a  poor  measure  of  visual 
fatigue.  In  a  comprehensive  review*  von  Cranach  et  al.  (19^9)  indicated  that 
blink  rate  is  sensitive  not  only  to  arousal  indiced  by  stressors  and  fear* 
developing  fatigue,  and  similar  state  varviables  but  also  to  variables*  like 
the  occurrence  of  head  movements  and  large  amplitude  saocades,  which  may  re¬ 
flect  task  requirements  as  ;will  as  state.  Too  many  variables  other  than  state 
contribute  to  blink  rate  for  it  to  be  an  adequate  measure  of  alertness  in 
visual  information  processing.  It  may  be,  however,  that  in  relatively  constant 
tasks,  within-subjoct  variations  in  blink  rate  do  reflect  state  variation. 

There  is  evidence,  based  on  more  refined  measures*  that  blinking  is  in¬ 
fluenced  directly  by  attentional  requirements  of  task  performance.  Boelhower 
and  Srunia  (1977)  studied  electromyographic  components  of  the  blink  recorded 
while  subjects  were  performing  an  auditory  binary  choice  decision  task.  They 
identified  two  EMO  components  of  ths  blink  reflsx.  Amplitude  of  the  early 
component  was  enhanced  during  task  performance  relative  to  rest  while  latency 
of  the  late  component  was  increased  during  task  performance  relative  to  rest. 
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These  result#  are  important  to  thia  discussion  because  they  demonstrate  that 
blinking  is  not  merely  a  reflex  response,  but  is  coordinated  with  cognitive 
processing  at  some  CNS  level,  Review  of  the  blink  rate  literature  and  our 
own  observations  have  shown  us  that  blink  rate  per  se  is  not  a  sufficiently 
sensitive  measure  of  changes  in  alertness.  Measures,  such  as  latency  of  blink 
components  used  by  Boelhower  and  Brunia  (1977)  allow  dear  damonstratlon  of  a 
relationship  between  blinking  and  tatok  performance  relative  to  rest,  but  are 
not  always  easily  related  to  components  of  task  performance.  Since  the 
measurement  of  latency  requires  that  responses  be  time-locked  to  triggering 
stimuli,  this  type  of  measure  is  not  easily  adapted  to  operational  situations 
in  which  much  of  task  performance  may  be  waiting  and  watching.  We  have  con¬ 
centrated  on  a  measure  which  can  be  used  in  operational  settings:  blink 
timing  with  respect  to  components  of  task  performance. 

Blini.a  are  generally  not  randomly  distributed  in  time  but  rather  occur 
most  frequently  at  times  of  reduced  information  processing  need.  We  have 
observed  that,  during  reading,  there  is  a  marked  inhibition  of  blinking  as  a 
page  of  text  Is  read.  The  degree  of  blink  inhibition  varies  with  the  reader's 
interest  in  the  text.  In  sharp  contrast,  there  is  a  marked  fD.urry  of  blinks 
as  the  reader  turns  from  one  page  of  text  to  the  next.  Ponder  and  Kennedy 
(1972)  have  reported  the  same  phenomenon.  Blink  patterning  is  not  restricted 
to  reading.  In  both  simulated  and  real  automobile  driving,  we  see  an  increase 
in  1  linking  during  periods  of  low  visual  information  processing  requirements. 
For  example,  blinking  increases  while  the  subject  sits  at  an  intersection 
waiting  for  the  traffic  light  to  change.  In  their  Investigation  of  the  timing 
of  blinks,  Poulton  and  Gregory  (1952)  and  Gregory  (1952)  found  that  in  both 
visual  and  nonvisual  tasks,  blinking  was  inhibited  during  the  performance  of 
difficult  task  components.  Similarly,  in  a  study  of  79  subjects,  ve  found 
marked  blink  inhibition  during  intake  of  information  processing  necessary  to 
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taek  completion  u  compared  to  a  comparable  reat  period  (Stern,  Oster  &  Newport, 

1980). 

Those  blinks  which  do  occur  during  task  performance  are  often  coordinated 
with  other  task  events.  Qreupner  (196U)  reported  that  blinking  occurs  at 
times  least  disturbing  to  overall  task  performance.  Zn  automobile  driving, 
blinks  are  often  associated  with  the  large  saccades  and  head  movements  which 
accompany  change  of  ga2e  from  road  to  rear-view  mirror  and  back.  Similarly, 
blinks  often  attend  the  return  from  instrument  panel  scanning.  It  is  our 
impression  that  for  many  subjects,  this  blink-task  coordination  begins  to 
break  down  as  time  on  task  increases. 

The  above  studies  agree  that  blinks  occur  at  moments  opportune  in 
terms  of  visual  Information  processing  requirements.  Results  indicate  that 
blinking,  though  generally  thought  of  as  a  reflex  response,  is  coordinated 
with  information  processing  load.  This  coordination  is  conducive  to  aocurate 
task  performance  and  is  in  that  sense  efficient.  It  is  our  impression  that 
the  occurrence  of  blinks  at  opportune  moments  ooeurs  prindipally  under  condi¬ 
tions  in  which  the  subject  is  vide  awake,  alert,  and  highly  motivated}  under 
conditions  of  monotony,  fatigue,  etc.,  there  is  a  breakdown  of  this  coordina¬ 
tion  between  blinking  and  aspects  of  visual  information  processing  and  task 
performance.  We  suspect  that  the  analysis  of  blink  timing  and  patterning 
vithin  the  task  will  protide  important  information  about  the  efficiency 
with  which  a  subject  is  processing  visual  information  and  making  decisions 
baasd  on  that  information. 

3.  Blink-associated  saccades 

Coordination  between  blinking  and  saccades  would  appear  to  minimise 
the  time  during  which  visual  information  processing  la  suppressed.  The  eye 
can  be  positioned  prior  to  the  blink  so  as  to  minimise  blink  closure  duration. 
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Further,  during  a  blink  the  eye  may  be  repoaitioned  to  preclude  the  neoeealty 
of  additional  aaooades  immediately  subsequent  to  the  blink.  Zn  alert, 
veil-motivated  subjects,  there  is  often  an  aasooiation  of  blinks  vith  saooadio 
eye  movement . 

We  have  observed,  in  operational  as  veil  as  laboratory  situations,  that 
many  subjects  demonstrate  a  specific  pattern  of  ocular  activity  preceding  the 
blink.  A  saccadic  eye  movement  shifted  eye  position  to  the  lover  quadrant  of 
the  visual  field.  Shifting  eye  position  to  the  lover  area  of  the  visual  field 
is  Invariably  accompanied  by  a  partial  closing  of  the  eyelid*.  A  blihk  from  a 
position  of  partial  lid  alosure  should  take  less  time  to  complete  than  on* 
started  vith  the  eyes  fully  open.  Sinoe  the  viever's  vision  is  obscured 
during  a  major  portion  of  the  blink,  reducing  blink  duration  reduces  the 
time  vision  is  obscured. 

During  saccadic  movement  and  the  periods  immediately  preceding  and 
follovlng  a  saccade,  information  abstraction  is  compromised  (Matin,  197^1 
Stern  &  Sanders,  1980).  Blinking  also  is  associated  vith  a  temporary  block¬ 
ing  of  visual  input.  Making  a  saccade  during  a  blink  la  thus  efficient  in 
that  it  reduces  the  total  time  during  which  visual  input  is  not  possible. 
Sacoades  in  the  horizontal  plane  can  be  detected  from  eleotroooulographio  reo- 
orda  and  ve  have  observed  that  they  frequently  do  occur  in  conjunction  vith 
an  eyeblink.  Vertical  eaccades  are  obscured  by  the  larger  signal  generated 
by  the  blink  itself.  The  occurrence  of  eye  repositioning  in  the  vertical  plane 
can  be  Inferred,  however,  by  noting  difference!  in  eye  poeition  follovlng  a 
blink.  During  visual  search,  eye  position  following  a  blink  is  consistently 
different  from  eye  position  preceding  a  blink  in  both  vertical  and  horizontal 
plane*.  Presumably  the  viewer  positions  the  eye  during  the  blink  ao  that  when 
vision  Is  restored  he  will  bo  looking  at  the  target.  By  obviating  the 
need  fox*  an  additional  saccade  to  reposition  the  eye  after  the  blink,  and  the 
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concomitant  saccadic  suppression,  the  time  that  vision  is  obscured  is  reduced. 

The  pattern  of  saccadic  movement  before  and  during  the  blink  reduces  the 
time  vision  is  obscured  by  reducing  the  time  for  blink  execution,  the  period 
of  blink  and  saccadic  suppression,  and  the  need  for  an  additional  saccade  to 
change  eye  position  after  the  blink.  Zn  this  sense  it  is  efficient.  It  is  oar 
impression  that  this  efficient  coupling  of  saccades  and  eyeblinks  is  affected 
by  variables  associated  with  decrements  in  performance  like  time  on  task  and 
motivation. 


4.  Fixation  duration  (micro-sleep)  ' 

It  Is  wsll-doeuasnted  that  fixation  pause  duration,  i.e.,  the 
amount  of  time  the  eyes  dwell  on  a  particular  aspect  of  a  visual  display,  is 
a  function  of  the  task  (Fisher,  1974;  Oould,  1973).  Moreover,  moment -by-raomsnt 
analyses  of  eye  movements  reveal  variation  in  the  length  of  the  fixation  pause 
related  to  cognitive  processing.  It  is  reasonable  to  assume  that  unusually  -j 

long  fixation  durations  reflect  periods  of  nonprocessing  due  to  loss  of 
alertness.  Specifically,  unduly  long  fixation  pauses  may  reflect  drop-outs  in 
performance.  Such  long  fixation  pauses  could  mean  either  that  the  viewer  is  ■] 

j 

spending  more  time  sampling  a  very  restricted  aspect  of  the  visual  display  or  | 

that  he  is  simply  "staring"  at  the  display  without  necessarily  doing  much  | 

-1 

seeing.  Since  the  type  of  task  will  affect  fixation  duration,  the  duration  * 

i 

Indicating  staring  or  drop-outs  in  performance  as  opposed  to  detailed  visual  jj 

analysis  will  vary  from  task  to  task.  Our  cumulative  experience  with  fixation  j 

pause  durations  rcoorded  during  reading  indicates  that  fixation  pauses  in  excess  j 

of  400  msec  are  Indicative  of  staring  or  nonreading  (Under  nonreading  we  would  | 

include  taBk  relevant  behavior  euch  ae  thinking  about  the  text  Just  read.).  1 

j 

In  the  driver  simulator  task,  we  have  used  2  sec  or  greater  at  an  indicant  of  j 

unusually  long  pause  durations.  1 

Several  results  have  suggested  that  an  unduly  long  fixation  duration  ie  j 

indicative  of  decline  in  alertness  and/or  momentary  lapses  in  attention.  I 

sarjiass . . . . . . .  . 
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We  have  found  that  the  inoidenoe  of  long  duration!  lnaraaaca  with  time  on  task 
and  with  ingeation  of  CNS  depraaaant  druga  like  aloohol.  Moreover,  auoh  lapaea 
do  not  ooour  at  random  during  taak  performance.  In  reading,  exceedingly  long 
fixation  pauaea  are  usually  the  last  paueo  on  a  line  of  text  or  the  firat 
pauae  on  a  line  of  text.  Long  duration  fixation!  alao  occur  at  predictable 
timea  in  aimulabed  helicopter  flying.  Specifically,  8tave  (1977)  found  lapaea 
in  performance  to  he  aignificantly  correlated  (r  »  0.87)  with  subjective  ratinga 
of  fatigue. 

5.  Sacoade  amplitude,  velocity,  and  their  interrelationship. 

Several  parameters  of  aaccadea,  the  quick  jumps  of  the  eye  to 
ohange  eye  position,  are  sensitive  to  organiamio  atatea  of  alertness.  Among 
theae,  aaccade  amplitude  hao  been  uted  aa  an  indicant  of  ohangea  in  attention 
to  aapecta  of  the  environment.  Cedar  (1977)  recorded  eye  movements  during 
aimulated  automobile  driving  and  found  that  traffic  flow  conditions  signific¬ 
antly  affected  aaccade  amplitude.  As  driving  etreae  increased,  the  number  of 
large  amplitude  eye  movements  (greater  than  9.8°)  significantly  decreased. 
Time-on-taek  also  influences  the  frequency  of  large  amplitude  aacoadee.  We 
(Troy,  Chen  &  Stern,  1972)  have  demonstrated  that  in  helicopter,  pilots 
flying  a  relatively  simple  kj-minute  mission  there  is  a  significant  decrease 
in  large  amplitude  aaccadea  between  early  and  late  portions  of  the  flight. 

We  interpreted  theae  results  as  suggesting  that  the  pilot  spends  lass  time 
looking  for  "targets  of  opportunity"  (places  to  land  in  an  emergency,  import¬ 
ant  aapecta  of  terrain,  etc.),  aa  a  function  of  time  on  taak.  8imilar  result* 
vara  obtained  in  the  automobile  simulator.  The  frequency  of  large  amplitude 
aaccadea  decreased  during  a  kO-minute  driving  taak.  Further,  lov  to  moderate 
doeas  of  alcohol  increased  the  effect i  the  frequency  of  such  aaccadea  vaa 
lover  and  the  decrease  more  rapid  under  conditions  of  intoxication. 


Sfcl#*.*,.-,  „ ...  , 
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Velocity  of  the  aaecadio  movement  has  also  been  investigated  in  several 
laboratories.  We  (Stern,  Bremer  &  McClure,  197U)  as  veil  as  Qentles  and 
Llvellyn-Thomas  (1971)  and  Asohoff  (I96U ) ,  have  demonstrated  significant 
decrements  in  the  peak  velocity  of  large  (10-20°)  saooades  after  ingestion 
of  minor  tranquilizers  (e.g.,  librium  and  valium).  Recent  data  from  our  labora¬ 
tory  demonstrate  that  this  phenomenon  is  not  unique  to  large  amplitude  saooades 
but  occurs  In  smaller  amplitude  aaccades  as  veil. 

We  have  studied  both  sadcade  amplitude  and  velocity  and  find  a  combination 
of  the  tvo  measures  to  be  most  useful.  The  maximum  velocity  of  eye  rotation 
during  the  execution  of  a  sacoade  is  dependent  upon  the  distance  the  eye  has 
to  travel.  For  aaccades  ranging  from  a  9°  to  20°  excursion  the  relationship 
between  peak  velocity  and  sacoade  amplitude  is  essentially  linear  (Outer  fc 
8tern,  1979)*  We  have  demonstrated  that  time-on-task  and  "state  of  the 
organism"  have  a  significant  effeot  on  this  relationship.  We  have  consistently 
found,  for  example,  that,  as  a  funotion  of  time-on-task,  the  slope  of  the 
regression  line  describing  linear  amplitude-velocity  relationship  decreases. 

Data  from  one  recent  study  illustrates  the  sensitivity  of  the  saoeade 
amplitude-velocity  relationship  to  both  tlme-on-task  and  change  of  state 
effects.  The  study  involved  participants  for  four  one-hour  experimental 
soosions.  During  each  cession,  subjects  read  from  Haley’s  Hoots  and  after 
US  min.  of  reading  were  roquired  to  ansvsr  questions  regarding  the  text  they 
had  read.  In  sessions  2,  3,  and  U  they  vere  required  to  drink  a  sufficient 
quantity  of  alcoholic  beverage  to  bring  BAC  level  to  0,  .3$,  or  .70  mgmft. 

Order  of  level  of  BAC  ueed  vas  randomized  over  sessions.  Eye  movement  data 
from  an  early,  middle  and  final  segment  of  reading  vere  analysed. 
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The  correlation  between  saocade  amplitude  and  velocity  generally  averaged 
above  0.70.  Under  conditions  of  inebriation!  the  elope  of  the  regression  line 
Is  significantly  reduced  (p<.0005).  A  similar  effect  is  found  for  time  on  task 
(p<.002).  We  also  found  the  coefficient  of  correlation  (aro  sine  transformed)  . 
is  significantly  reduced  by  both  alcohol  (p  4.002)  and  time  on  task  (p  4.028). 

The  advantages  of  utilizing  the  correlation  between  amplitude  and  velocity 
over  amplitude!  duration,  or  peak  velocity  alono  are  twofold.  Change  in 
amplitude  might  reflect  changing  cognitive  processes  or  strategy  of  the  observer 
as  well  as  change  in  state.  The  observer  may  simply  decide  to  search  a  restricted 
area'  of  the  display.  Interpretation  of  the  relationship  between  amplitude  and 
velocity  is  less  ambiguous.  The  second  advantage  is  that  the  measure  is  ideal,  for 
determining  deviations  from  the  alert  state.  A  relatively  simple  system  could  be  de¬ 
veloped  which  calculates  the  regression  aquation  under  conditions  of  optimal  alert¬ 
ness  and  then  compares  successive  data  points  to  that  equation  and  determines  the 
number  of  saocade  velocities  falling  significantly  balow  the  predicted  velocity. 

6.  Utility  of  eye  movement  measures. 

We  have,  in  previous  research,  consistently  noted  that  the  oculomotor 
measures  outlined  above  arc  affected  by  variablee  such  aa  attentiveneaa  and 
alertnena.  We  believe  that  they  can  be  used  effectively  to  identify  variations  in  auch 
states,  perhaps  more  adequately  than  direct  measures  of  performance  outooue.  One 
superiority  of  oculomotor  parameters  is  that  thsy  are  sensitive  to  momentary 
changes  (lapses,  drop-outs),  as  well  as  tonic  changes  In  state.  Further,  oculomotor 
measures,  unlike  outcome  measures,  can  provide  evidence  of  change  of  state  in  the 
absence  of  response  to  specific  stimuli.  A  change  in  blihk  duration  can  be  used  to 
identify  declining  alertness  though  ths  subject  is  marely  watching,  responding  to  no 
specific  stimulus.  Outcome  measures  can  be  collected  only  when  specific  response  to 
specific  stimuli  is  made  a  sufficient  number  of  times  to  yield  reliable  error  rates. 


. 
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Since  operation  of  complex  instrumentation  Involves  periods  of  scanning  and  anti¬ 
cipation,  measurement  of  eye  movement  parameters  vhioh  can  be  used  to  assess  change 
of  state  during  these  periods,  is  more  useful  than  measures  of  performance  outcomes. 
Third,  performance  measures  are,  of  necessity,  available  only  after-the-fact.  In  an 

1 

operational  setting,  it  would  be  of  obvious  utility  to  predict  performance  deoremente 
before  they  actually  occur.  We  believe  that  oculomotor  indlcee  of  state  will  be  pre- 

4 

1 

dictive  of  performance  degradation.  Finally,  it  is  our  belief  that  defining  porlods  ‘ 

1 

during  which  one  can  expect  decrements  in  performance  on  the  baale  of  the  proponed  ; 

ocular  measures  may  be  a  sensitive  and  uaaful  approach  einoe  such  measures  oan  be  i 

obtained  under  operational  as  well  as  laboratory  condition*. 

Although  all  of  the  measures  described  above  oould  be  utilised  as  indexing  vori-  I 

| 

ablea ,  we  have  eleatod  to  concentrate  out  initial  effort  on  the  blink  and  blink- 
related  measures.  The  reasons  for  this  are  primarily  pragmatio.  First,  data  reduction! 
routines  for  the  detailed  kind  of  analysis  required  in  the  present  research  oould  be  j 

I 

readily  developed  from  existing  software.  Second,  eyeblinks  occur  in  all  situations,  * 

4 

and  selection  of  aspects  of  blinking  as  the  primary  oculomotor  measure  allowed  greater  j 

) 

flexibility  in  the  selection  of  an  appropriate  task.  An  immediate  concentration  on  ? 

■S 

aspects  of  saccadic  motion  would  have  required  a  task,  the  successful  performance  of  j 
which  demanded  horisontal  scanning.  Such  tasks  are  contemplated  and  aubsequent  rcsearoS 
will  consequently  Include  examination  of  all  tho  measures  detailed  above.  The  present  j 
report,  however,  is  restricted  to  consideration  of  blink  parameters  as  relatsd  to  task  1 
performance ,  j 


4 

As  stated  earlier,  our  major  objective  is  to  Identify  changes  of  stats  and  t|j 
determine  how  they  affect  components  of  task  performance.  In  the  previous  section 

< 

we  documented  how  parameters  of  recorded  eye  movements  con  be  used  to  identify  i\^  , 
changes  in  state.  In  this  section  ve  will  describe  how  ve  go  about  the  process  of 
distinguishing  decision  making  and  motor  components  in  reaction  time  tasks  involving  ] 
visual  stimuli  and  manual  responses,  Fractionating  reaction  time  (RT)  is  useful  in  ] 


1 
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assessing  whether  reduced  alertness  differentially  affects  the  time  it  takes  to 
make  decisions  based  on  visual  information  and  the  time  it  takes  to  execute  those 
decisions,  once  made. 

In  several  previous  studies  ve  have  fractionated  RT  to  visual  stimuli  using 
a  series  of  tasks  in  which  a  primarily  peroeptual-cogbitive  and  a  primarily  motor 
response  oould  be  measured.  In  these  studies  subjects  were  instructed  to  mske  on 
appropriate  (choice-)  reaction  response  as  rapidly  as  possible  following  stimulus 
onset,  and  to  return  to  the  starting  position  immediately  after  stimulus  termlna- 

j 

tion.  Several  components  of  the  response  were  abstracted  on  each  trial.  Decision 
time,  the  perceptual-cognitive  component  of  RT,  was  the  time  between  light  onset 

} 

(or  offset)  a.'d  button  release.  Transit  time,  the  motor  component  of  RT,  was  the  J 

time  botween  contact  release  and  contact  of  the  next  switch,  l.e.,  the  time  it  1 

■3 

took  to  move  the  finger  from  one  button  to  the  next.  Decision  and  transit  time  j 

components  were  measured  for  both  forward  movement  from  the  start  to  target  positions'! 

i 

and  for  return  movements  from  target  to  start  positions.  There  were  thus  measures  I 

j 

of  RT  under  four  conditions:  decision  time  forward  (DTK),  transit  time  forward  -j 
(TTR),  decision  time  return  (DTR),  and  transit  time  return  (TTR). 

To  provide  ahecko  on  the  validity  of  our  measure  of  perceptual  and  motor  i 

components  of  RT,  ve  havo:  a)  manipulated  the  complexity  of  a  vieuo-spatlal  task  j 

and  b)  required  both  left  and  right  hand  responses.  Our  reaaoning  was  that  If  ) 

) 

decision  and  transit  time  reflect  perceptual -cognitive  and  motor  functions, 

} 

respectively,  increasing  the  complexity  of  the  decision  about  whloh  hand  to  move  in  i 

i 

roeponse  to  a  specific  light  ehould  affect  decision  time,  but  have  minimal  effects 
on  transit  time.  Second,  a  faster  left  hand  response  was  anticipated  for  the  j 

j 

perceptual  (DTP)  component  of  RT  because  there  ia  a  demonstrated  right  hemisphere  i 
advantage  for  visual  perception  tasks  and  because  the  right  hemisphere  controls 
fine  motor  responses  on  the  left  side  of  the  body,  A  faster  right  hand  response  val 
expected  for  trar.eit  time,  the  motor  component  of  RT,  because  faster  motor  response j 
is  generally  associated  with  moving  the  dominant  or  preferred  hand.  ■! 


Contract  Fl+9620-79-C-0089/l8 


We  also  entertained  different  expectations  for  the  forward  and  return  move¬ 
ments  .  Instructions  regarding  stimulus-response  contingencies  vers  manipulated 
so  that  the  decisions  required  preparatory  to  the  forward  movement  were  more  com¬ 
plex  than  those  required  prior  to  the  return  movement.  Before  making  the  forward 
movement  the  subject  had,  in  some  conditions,  to  deoide  which  hand  to  move,  depend¬ 
ing  on  which  light  was  illuminated \  in  return  movements  the  subject  had  Invariably 
to  return  whichever  hand  was  away  from  the  start  position  back  to  that  position. 

DTP  was,  then,  a  measure  of  more  complex  perceptual-opgnitive  response  than  DTR. 
Task  complexity  was  expeoted  to  affect  DTP  more  than  DTR.  No  such  differential 
effect  of  task  complexity  was  expected  for  TTF  and  TTR. 

The  results  of  several  experiments  (Stern,  Oster  fc  Newport,  1979,  1980) 
generally  confirm  that  our  measures  of  decision  time  and  transit  time  do  reflect 
perceptual-cognitive  and  motor  components  of  RT  to  visually  presented  utimuli. 
First,  decision  time  was  generally  more  than  twice  as  long  as  transit  time,  as 
would  be  expected  of  the  time  necessary  to  arrive  at  a  decision  au  compared  to 
the  time  neaessary  to  enact  that  decision  (motor  time).  Second,  as  expected, 
task  complexity  increased  decision  time  aspects  of  DTF  but  had  comparatively 
minimal  effects  on  transit  time  and  DTR.  Task  complexity  accounted  for  h5)(  of 
the  variance  in  DTF,  as  compared  to  5K  for  DTR,  and  1#  for  both  TTF  and  TTR. 

Third,  there  was  a  significant  hand  by  decision  vs.  transit  time  interaction. 
Decision  times  were  more  rapid  with  the  left  hand  response  and  tranelt  tlmee  were 
faster  for  right  hand  responses.  However,  this  result  was  significant  only  for 
the  forward  movement,  i.e.,  DTF  and  TTF. 

III.  RESEARCH  CONDUCTED 

The  completed  research  was  conducted  in  four  phases.  The  first  phase  in¬ 
volved  the  selection  of  a  general  version  of  a  visual  information-prooaaeing  task 
and  ths  development  of  a  hardware/software  system  for  task  presentation.  The 
seoond  step  was  a  preliminary  study  coopering  the  effectiveness  of  several 
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variations  of  the  task,  evaluating  oculomotor  changes,  performance  variation,  and 
subject's  subjective  report,  In  phase  three  a  formal  study  was  conducted.  The 
final  phase  involved  the  reduction  of  the  f squired  data,  Concomitant  with  this 
effort,  software  development  of  an  analysis  system  for  saocade  amplitude-velocity 
measures  continued.  Further,  a  feasibility  study  was  conducted  to  assess  the 
possible  development  of  a  portable  microcomputer  system  for  field  measurement  of 
ooulomotor  parameters. 

A.  Task  Sdeotlon  and  Software  Development 

Minimal  requirements  for  an  experimental  task  were  that  it:  1)  yield 
frequent  measures  of  performance  adequacy;  2)  be  primarily  visual  in  nature;  3) 
provide  ooulomotor  measures j  and  4 )  be  subject  to  fatigue,  or  fatigue-like, 
state  ohanges.  It  was  further  desirable  that  the  task:  5)  correspond,  at  least 
theoretically  to  real-life  field  situations;  6)  involve  both  memory  and  decision- 
making  in  Information  processing;  and  7)  not  require  extensive  periods  of  training. 

We  designed  an  information-prooessing  reaotion-time  task  whioh  satisfied 
most  of  the  above  criteria.  A  continuing  sequence  of  alphabetical  stimuli  were 
presented  on  a  screen.  Each  stimulus  letter  occasioned  a  response.  The  eubjeot 
was  required  to  oonvpare  the  letter  with  the  previously  presented  letter,  make  some 
categorical  deoiaion  based  on  the  relationship  between  tho  two  letters  and  perform 
a  ohoioci-reaotion-t&sk  response  based  on  that  decision.  This  constitutes  a  fre¬ 
quently  elloited  behavioral  response  yielding  performance  indicants  based  both 
on  error  measures  and  on  measures  of  fraotioneted  RT.  It  is  a  visual  task  requiring 
memory  for  previous  stimuli  as  well  as  a  decision  regarding  the  current  stimulus. 

Clearly,  there  are  a  large  number  of  possible  decision  rules  whioh  oould  be 
based  on  the  sequential  relationship  between  letters.  The  program  developed  to 
oontrol  the  experimental  sessions  was  built  to  incorporate  several  of  these 
possibilities.  The  variations  included  were:  CAKE,  upper  vs.  lower; 
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alphabetical  SEQUENCE)  sequential  letters  either  Immediately  adjacent  in  the 
alphabet  or  not;  and  CATEGORY)  vowel  or  oonsonant.  The  latter  two  oould  be  com¬ 
bined  with  the  first  to  generate  more  dlffloult  tasks. 

The  basic  hardware  consisted  of  a  PDP-11/40  computer  with  its  associated  . 
peripherals  and  "in-house"  constructed  special  devices.  Software  and  hardware 
development  specific  to  this  research  progressed  in  an  integrated  fashion.  On 
entering  the  experimental  program  ( NUALPH ) ,  the  operator  selected  the  task 

t 

parameters.  At  initialization  the  value  of  the  "previous  stimuluo  was  oet  to 
the  upper-oase  letter  "A")  the  inter stimulus  interval  counter  was  set  to  3  sec, 
and  the  olook  started  at  a  10  msec  tick  interval.  For  tha  first*  and  aaoh  sub¬ 
sequent  trial,  the  program  then  progreaeed  through  a  serlee  of  oalla  to  a 
random  number  generator  routine.  If*  for  example*  the  task  variation*  CASE*  had 
bean  solected,  a  random  lettar  was  ploked*  then  a  random  probability  value  wee 
eeleoted.  If  this  value  exceeded  that  speolfled  by  the  operator  as  the  percent 
of  occasions  on  which  case  should  ohangs*  then  the  case  of  the  randomly  selected 
letter  was  made  the  same  as  that  of  the  previously  presented  letter.  Otherwise  * 
the  case  was  altered.  Similar  procedures  were  followed  for  the  other  task 
variations.  After  the  generation  of  the  character,  the  random  number  generator 
wee  again  addressed,  this  time  to  select  a  stimulus  duration  from  a  rectangular 
distribution  of  possible  durations  within  limits  set  by  DATA  statements  in  the 
program.  The  X  and  Y  coordinates  of  the  eoreen  loaation  for  the  next  stimulus 
we  determined  in  a  similar  manner.  The  program  then  looped  until  the  oonolusion 
of  the  interstimulus  interval. 

At  that  time  the  ASCII  code  of  the  generated  signal  was  transmitted  via  a 
RS232  interface  to  a  Magnavox  plasma  display  terminal  located  in  the  nearby  experi¬ 
mental  room.  A  plasma  terminal  was  selected  rather  than  a  traditional  display 
scope  because  it  provides  more  acournte  oontrol  of  the  exact  time  of  stimulus 
ocourrance.  The  zero  peruietenue  of  the  image  on  the  type  of  display  further 
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allows  accurate  determination  of  latency  of  the  response  to  stimulus  offset. 

Three  additional  events  ooourred  coincident  with  stimulus  transmission.  1) 

Latenoy  and  interval  times  were  reset.  2)  The  ASCII  cod*  for  actual  charaoter 
presented  was  stored  in  an  array  for  subsequent  listing.  3)  A  coded  indication  of 
stimulus  status  (In  or  out  of  SEQUENCE,  change  in  CASE,  and/or  change  of  CATEGORY ) 
was  placed. on  the  digital  output  lines  of  the  computer.  The  digital  signal  was 
used  to  activate  a  telephone  frequency  encoder  unit  which  generated  those  tones 
corresponding  to  the  digital  signal.  These  frequency  enooded  numbers  were  then 
reoorded  on  a  standard  audio  channel  of  a  tape  reoorder  to  be  used  in  subsequent 
off-line  data  analyses. 

The  program  then  randomly  selected  the  duration  of  the  next  inter stimulus 
interval  and  entered  a  wait  loop  until  the  oonoluslon  of  the  stimulus  duration 
interval.  At  that  time  the  soreen  was  erased,  interval  and  latenoy  oountere  reset, 
and  the  digital  output  lines  oleared.  The  program  looped  through  this  entire 
procedure  for  an  operator-selected  number  of  trials  and  then  printed  the  aooum- 
ulatod  data  for  that  trial  block  on  a  line  printer. 

Choioe  responses  were  recorded  from  a  three  position  touoh  pad  panel  situated 
in  front  of  the  display  terminal  (see  Figure  2).  A  pioee  of  oonduotive  foam  was 
attaohed  both  to  the  subject's  wriot  and  to  tho  grounding  oirouit  of  the  response 
panel  suoh  that  when  the  subject  touohed  any  of  the  response  pads  a  oirouit  was 
completed.  The  panel  was  wired  so  that  any  change  in  state  (i.e.,  either  making 
or  breaking  oontaot  with  a  touch  pad)  generated  an  interrupt  signal  on  the  digital 
input  lines  to  ths  computer.  Separate  bite  on  the  digital  line*  corresponded  to 
each  of  the  Individual  touoh  pads.  The  response  panel  also  ouptut  a  d.o.  voltage, 
the  levol  of  whioh  ie  proportional  to  the  numerical  code  of  the  touch  pad  oontaoted. 
This  d.o.  signal  was  fed  direotly  to  the  tape  reoorder. 
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Figure  2.  Task  Apparatus.  Tha  equipment  consists  of  a)  a  vidao  monitor,  a  touoh- 
pad  raaponaa  panel  oonaiating  of  a  proximal  "home"  pad  and  two  distal  choice  pada 
for  tha  primary  task.  Tha  lower  portion  of  the  figure  aohamatioally  illustrates 
tha  four  RT  components  of  tha  primary  taBkj  b)  DTP,  time  between  ctimulus  onset 
and  release  of  the  home  pad)  o)  TTF,  time  the  finger  la  off  the  key)  d)  DIR,  time 
between  stimulus  offset  and  ohoioe  pad  £ /Lease)  and  e)  TTR,  movement  time  from 
ohoice  to  home  pad. 
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On  reoeipt  of  a  digital  input,  the  program  executed  a  software  interrupt. 

The  numerical  code  for  the  response  and  the  contents  of  the  latency  counter  were 
moved  into  the  print  array.  This  information  was  thue  included  in  the  printout 
after  each  trial  block. 

The  complete  instrumentation  set-up,  illustrated  in  figure  3/  included  a  dual 
eye  movement  amplifier.  These  circuits  amplified  the  eleotroooulographio  signals 
(picked  up  by  appropriately  located  Beolcnan  biopotential  electrodes)  prior  to 
transmitting  to  the  tape  reoorder.  Horizontal  and  vertioal  EQG  were  reoorded 
separately. 

The  NUALPH  program  generated  stimuli  and  monitored  the  behavioral  response. 
Reaction-time  measures  (both  time  and  error)  were  immediately  available  from  the 
real-time,  on-line  analysis.  A  second  program  was  developed  for  off-line  analysis 
of  the  tape  recorded  data.  This  reduction  program  converted  four  tape  reoorded 
channels  of  data  from  cnalogue  to  digital  format.  Successive  10  second  frames  of 
this  data  were  displayed  in  graphic  form  at  the  computer  terminal.  Reduction 
routines  for  three  of  theae  channels  wore  incorporated  into  the  program.  They 
were:  1)  stimulus;  2)  choice  response;  and  3)  vertioal  E00.  The  vertioal  E00 
was  analyzed  for  the  oocurrenoe  of  blinks  and  characteristics  of  each  blink,  time 
of  occurrence,  amplitude,  half-closure  duration,  and  window  duration  (as  defined 
in  section  II.B.l  of  this  report)  were  abstracted, 

B.  Preliminary  Studies 

Eight  subjects,  primarily  laboratory  personnel,  were  run  for  varying 
time  periods  to  assess  the  effectiveness  of  the  task.  All  task  variations  and 
several  complex  decision  rules  involving  combinations  of  task  variations  wers 
employed,  The  first  several  subject  runs  were  analyzed  only  with  respect  to 
the  performance  measure.  It  rapidly  became  apparent  that  the  more  complex  rules 
were  too  difficult  to  master.  Using  a  complex  rule,  such  ast  (press  lift  if 
case  has  changed  and  the  letter  Is  not  in  alphabetical  sequence)  or  (if  the  case 
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is  the  same  and  the  letter  is  in  sequence)  otherwise  press  right,  produced 
very  unstable  performance.  Error  rates  were  high  and  deoision  time  excessively 
variable.  Asymptotio  performance  levels  were  not  obtained  within  1-1.9  hours. 

On  the  other  hand,  simple  oategorioal  rules  (e.g.  press  right  for  upper  oase  and 
left  for  lower  case)  eliolted  minimal  involvement  in  the  task.  Although  aubjeots 
rapidly  became  bored  there  was  no  apparent  falling-off  in  task  performance. 

Two  aubjeots  were  run  using  the  SEQUENCE  task,  and  two  using  CASE  with  a  change 
rule  for  periods  of  1  to  1.9  hours.  These  tasks  were  readily  learned)  asymptotio 
levels  of  performance  were  obtained  within  60-100  trials.  Choice  errors  declined 
to' about  91  and  remained  stable.  Similarly,  median  dealslon  time,  based  on 
suooessive  20-trlal  blooks,  although  highly  variable  across  subjects,  was  very 
stable  for  eaoh  Individual  subjaot. 

Blink  data  for  these  four  subjects  were  analyzed.  Three  of  the  four  aubjeots 
showed  increases  in  median  closure  duration  and  window  duration  from  early  to  late 
in  a  one-hour  session.  There  were  significant  variations  in  both  blink  frequency 
and  the  proportionate  ocourrenoe  of  long  closure  duration  blinks  across  the 
session.  As  figure  4  indicates,  many  of  the  eyeblinks  were  olosely  associated  with 
the  events  of  the  performance  task. 

Temporal  parameters  of  the  task  were  also  evaluated.  The  values  ultimately 
seleoted  were  a  1.90-9.00  second  range  for  stimulus  duration  and  a  2.00-6.00  second 
range  for  interstimulus  Interval.  This  provided  a  6.29  second  average  trial  dura¬ 
tion,  or  about  ten  sets  of  performance  measures  for  eaoh  minute  on  the  task.  The 
variability  insured  continued  visual  attention  to  the  stimulus  display.  This 
pace  seemed  to  provide  the  maximum  number  of  performance  measures  without  producing 
a  speed-induced  behavioral  break-down.  These  particular  values  are  approximately 
the  same  as  those  we  have  found  to  be  most  useful  in  choice-reaction  tasks  using 
other  types  of  visual  stimuli. 
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?i*urt  4.  Eyeblink  and  Motor-reaponeo  Coordination,  Rapreaentativ* polygraph 
tracing*  from  minuta  15  (aarly)  and  minuta  55  (lata)  of  tha  information  procaaaing 
reaction  tint  taak.  In  each  inatanca  tha  top  tracing  indicate*  atitnulua  occurrence 
tha  middle  tracing  ahowa  tha  manual  reaponaea,  and  the  lowar  tracing 
vertical  EOC  aignal.  Many  of  the  blink*  are  doaaly  aaaociated  with  the  motor 
reaponae.  The  circled  blink*  are  thoao  illuatratad  in  larger  J rf  1 

<p,  P  ).  Tha  raaponaa  channel  i*  ahovm  in  greater,  detail  in  Figure 2  (p.22  ). 
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C.  Experiment  It  Methods  and  prooadura 

Data  war*  oollaotad  from  16  experimental  aubjaota.  All  aubjaota  ware 
recruited  from  tha  Washington  University  oonmunityj  many  of  than  wara  atudanta, 

Thara  wara  8  malts  and  8  famalaa,  all  batwaan  19  and  29  yaara  of  aga.  Four  malaa 

a 

and  four  famalaa  wara  aaaignad  to  aaoh  of  two  conditions?  CASS  and  SEQUENCE . 
Subjaota  wara  paid.a  nominal  amount  in  raoognition  of  thair  participation.  Eaoh 
aubjeot  voluntarily  aignad  a  atandard  information  and  conaant  form  prior  to  tha 
axparlmantal  aaaaion.  All  prooaduraa  and  requirements  of  Air  Foroa  and  tha  National 
Inatitutaa  of  Haalth  partaining  to  aubjaot 'a  righta,  proteotion,  and  safety,  wara 
aatlaflad. 

Eaoh  axparlmantal  run  bagan  with  an  explanation  and  damonatration  of  tha  task. 
Bookman  miniature  biopotential  alaotrodaa  were  applied.  Vartloal  aleotrodaa  wara 
poaltloned  equidistant  from  and  diraotly  above  and  below  tha  oantar  of  tha  right 
aye.  Horlaontal  alaotrodaa  wara  mounted  in  the  horizontal  plana  through  tha 
oanter  of  the  ayaa  and  approximately  1  om  beyond  aaoh  outer  oanthua.  A  fifth  elec¬ 
trode,  aarving  aa  ground,  waa  applied  to  tha  oantar  of  tha  aubjaot* a  forahaad.  Tha 
akin  at  aaoh  electrode  alto  waa  oletnaad  with  aloohol  and  lightly  abraldad. 

Standard  Bookman  electrode  gel  and  maska  wara  uaad.  Subjeota  wara  given  written 
oopiea  of  the  lnatruotione  for  the  task  variation  to  be  read  during  the  initial 
set-up.  (Examples  of  the  instructions  used  are  inoludad  in  Appendix  A. )  After  all 
questions  had  been  answered  and  the  aet-up  was  oompleto,  there  waa  a  period  of  from 
2  to  10  minutes  during  whioh  the  operator  insured  that  all  equipment  was  functional 
and  that  tha  tape  reoorded  signals  ware  adequate. 

The  first  100  trials  wara  presented  in  five  blocks  of  20  trials  aaoh.  Thaaa 
ware  designated  as  training  and  praotioe  triala.  A  few  aubjaota  gave  indication, 
by  exoeaaive  errors,  that  they  had  not<fully  understood  the  instruotiona,  For  these 
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subjects,  tha  instructions  war*  rapaatad  between  trial  blocks,  aa  naoaaaary. 

At  laaat  8  blooka  of  90  triala  (for  some  eubjeots  2  or  3  blooka  of  200  triala) 
were  than  administered.  Tha  total  experimental  aaaaion  laatad  1.9-2  hour a. 

Actual  time  apant  performing  tha  taak  axoaadad  1  hour  in  every  instance, 

a 

Tha  program  NUALPH  waa  uaad.  Changa  proportion  for  GASS  was  sat  to  9 OX. 
Similarly,,  tha  proportion  of  itimuli  not  in  alphabatioal  ordar  in  tha  SEQUENCE 
oondition  waa  90S.  Tha  tamporal  parameters  for  aaoh  trial  wara  thoaa  aalaotad 
in  tha  praliminary  study!  1. 9-3*0  aaoonda  stimulus  duration  and  2. 0-6.0  intar- 
atioulua  intarval. 

D.  Experiment  1?  Reduction  and  rasulta 

Initial  analyaia  of  parformanoa  measures  was  baaed  on  tha  abstraction 
of  raaponsa  information  from  the  on-line  raoord  generated  by  NUALPH.  Three 
2 -minute  segments  of  tha  raoord  from  training  and  praotloa  trials  (designated 
Practice  I,  II,  and  III)  wara  aalaotad  for  examination.  These  segments  wara 
approximately  evenly  distributed  aoross  the  available  raoord  for  aaoh  subject. 

Three  9-rminute  segments  were  also  aalaotad  from  tha  long  runs.  These  segments 
designated  Early,  Middle,  and  Lata),  wara  about  minutes  2-7,  33** 38,  and  62-67 
of  tha  long  run.  Where  possible  and -.necessary  tha  exaot  time  period  waa  shifted 
forward  or  back  by  1  or  2  minutes  so  as  to  be  entirely  within  a  single  block. 

Where  that  was  not  possible,  the  period  between  blooka  and  encompassing  tha  first 
few  trials  of  the  block  which  began  in  tha  middle  of  tha  segment  wara  excluded 
from  analysis. 

Corresponding  segments  of  tha  recorded  data  wara  submitted  to  offline  analysis. 
This  analysis  provided  both  parformanoa  and  eyeblink  data  and  also  allowed  examin¬ 
ation  of  the  correspondence  batwaan  tha  two  seta  of  responses.  On  oooaslon,  whan 
vary  detailed  analysis  was  required,  portions  of  tha  previously  selected  segments 
or  other  portions  of  tha  data  were  abstracted. 


Contract  F49620-79-C-0089/29 

1.  Performance  measure*. 

Two  genaral  types  of  errors  wart  identified.  Decision  error* 
ere  those  in  which  the  subject  moved  to  the  right  key  when  he  should  have  moved 
to  the  left,  or  vio*  versa.  A  broader  error  category,  finger  timing  errors  (FT?), 
consisted  of  almost  all  other  inappropriate  or  inaoourat*  responses,  Xt  consisted 
primarily  of  1)  responses,  auoh  as  intertrial  tapping  or  antiolpatory  responding, 
whloh  resulted  in  the  subject  having  his  finger  removed  from  the  homd  pad  at  the 
time  of  stimulus  onset  and  2)  anticipatory  returns,  either  partial  or  completed, 
from  the  response  pad  to  the  home  pad.  As  figure  3  indidates,  the  proportion  of 
trials  on  whloh  error*  occurred  decreased  throughout  praotioe.  This  was  especially 
true  for  deolsion  errors .  A  portion  of  the  increased  aoauraoy  may  have  been  gained 
at  the  expense  of  speed,  There  is,  apparent  in  figure  6,  overall,  a  small  (non¬ 
significant)  increase  in  response  time.  Deolsion  Tim*  Return,  however,  shows  a 
significant  decrease ,  This  component  refleots  the  relatively  simple  deolsion  that 
stimulus  offset  has  occurred  (1,*,  it  is  in  esseno*  simple,  rather  than  ohoioe, 
reaotlon  time).  The  combined  results  from  these  two  sets  of  measures  indioate 
that  learning  is  progressing  throughout  the  praotioe  trials.  This  learning  Involves, 
in  part,  a  possible  speed-aocuraoy  tradeoff  to  optimize  performance.  That  learning 
is  largely  completed  at  the  conclusion  of  th*  practice  runs  is  indicated  by  the 
absence  of  any  difference  in  either  time-to-respond  or  errors  between  praotioe  III 
and  the  early  portion  of  th*  extended  trial  runs, 

Median  values  for  the  response  time  measure  did  not  vary  throughout  th*  ex¬ 
tended  runs.  Error  rates,  however,  increased  from  the  early  portion  to  later  por¬ 
tions  of  th*  task.  FTE  increased  first  followed  by  a  later  increase  in  deolsion 
errors.  The  inoroase  in  errors,  shown  in  figure  7,  corresponds  to  subject's  sub- 

t 

Jeotlva  reports  of  accumulating  fatigue,  boredom,  and  periodio  inattentiveness. 
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2.  Bysbllnk  measures 

As  predicted)  the  parameter*  of  the  blink  proved  sensitive  to 
tima-on-t&ak  and  henoe  to  fatigue  or  fatigue-like  state  ohangea.  The  conaiatent 
inoreaae  in  blink  rate  aorosa  the  entire  experimental  session  was  most  dramatio. 

e 

The  initial  average  of  19.7  blinks/minute  la  close  to  the  rate  (14)  reported  in  the 
literature  as  average.  We  have  observed)  in  visual  tasks  demanding  oontinual 
attention  (l.e.  reading))  blink  rates  as  low  as  3-8  per  minute.  By  comparison 
the  26.2  blinks/minute  average  exhibited  by  the  end  of  the  experimental  session 
in  the  present  experiment  seems  very  high.  The  steady  inoreaae  in  rat*  throughout 
the  session  is  illustrated  in  figure  8. 

Both  olosure  duration  measures,  half  amplitude  closure  and  20 t  window  closure, 
demonstrated  a  similar  pai.tem.  Each  of  these  measures  was  analyzed  in  two  waya. 
First,  the  median  duration  was  calculated  for  saoh  subjeot  during  each  of  the  six  time 
segments,  We  ejected  this  measure  to  refloat  tonlo  ohanges  in  alertness,  For 
the  second  analysis,  we  determined  the  proportion  of  blink  which  would  be  character¬ 
ized  as  exhibiting  long  durations.  On  the  basis  of  the  preliminary  study,  ws  aeleotsd 
190  msec  as  the  criterion  for  a  long  half-olooure  duration  and  100  meoo  as  the 
outoff  for  long  window  durations.  These  data  are  preeented  in  figures  9  end  10. 

3.  Eyebllrvk  and  manual  roeponse  ooordihation 

The  correspondence  between  blinks  and  the  choice  reaotlon  task,  noted 
in  the  preliminary  studies,  was  examined  more  closely.  Thirteen  of  the  16  subjeota 
had  sufficiently  high  blink  rate  to  yield  moaningful  proportionate  data  with 
restricted  segments  of  the  session.  For  saoh  of  these  13*  comparable  90  blink 
sample#  were  abstracted  from  practios  II  and  the  early  and  middle  portions  of  the 
extended  runs,  The  relationship  between  time  of  blink  initiation  and  both  stimulus 
and  response  events  was  determined. 

In  the  initial  determination,  blinks  falling  between  stimulus  onset  and  1  second 
after  stimulus  offset  were  designated  as  contingent.  This  categorization  accounted 
for  over  70X  of  all  blinks  (see  figure  11). 
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Figure  9.  Closure  Duration.  Inoreases.in  median  half  amplitude  closure  duration 
(upper  figure)  and  In  proportion  of  blinks  with  olosure  durations  in  excess  of  190 
msec  (lower  figure)  aoross  the  session, 
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n«n  10.  Window  Durotlon.  Variation  of  .adian  20*  window  duration  (uppar  flgur. 
tndtha  proportion  of  Winks  with  window  durations  exceeding  100  msao  (lowsr  figurs 
as  a  funotion  of  time  within  the  session. 
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Figure  11.  Event  Contingent  Bllnka.  The  upper  portion  of  the  figure  shows  the 
proportion  of  hlinke  initially  identified  ae  contingent.  The  lower  portion  ehowa 
the  relationship  between  blink  initiation  and  manual  response. 


' : -caesarr 


Contract  F49620-79-C-0039/ 38 


A  250  mseo  window  waa  then  constructed  around  each  teak  event  4  Sixty  percent 
of  the  contingent  blinke  fell  with  250  mseo  of  a  response.  The  percentage  within 
this  window  steadily  increased  from  55#  to  65#  across  the  three  time  periods  sampled. 

In  contrasti  slightly  less  than  25ft  of  the  contingent  blinks  fell  within  a  250 

s 

msec  window  around  the  stimulus  events. 

When  the  tightness  of  the  time-looking  is  examined,  it  beoomes  dear  that  the, 
blinks  associated  with  responding  are  more  tightly  coupled.  As  figure  12  shows, 
a  high  proportion  of  the  blinks  associated  with  a  response  were  initiated  within 
100  mseo  of  the  response.  The  same  was  not  true  for  stimulus  associated  blinke. 

4.  Eyabllnk  end  performance  measure  relationships 

Ws  examined  performance  on  trials  surrounding  trials  on  which  long 
closure  duration  blinks  occurred.  Suoh  a  trial  was  identified  as  a  critical  trial. 

One  trial  preoeeding  each  critical  trial  and  two  trials  following  it  were  abstracted. 
Combining  these  four  trial  types  and  d  looking  separately  st  the  data  for  E,  M, 

\ 

and  L  portions  of  each  subject' a  run  produoed  the  data  presented  In  figure  13. 

DTF  and  TTR  seemed  to  vary  little  from  segment  median*.  TTF  and  DTF,  however,  '\ 

tended  to  be  significantly  faster  than  segment  medians.  Examination  of  individual  • 

trial-types  indicates  that  this  sffeot  is  primarily  due  to  rapid  responding  on  the  \ 

'  S 

trialo  following  the  critical  trial.  There  was  also  a  slight,  though  not  signif-  \ 

•j 

ioant  tendency  for  DTF  to  be  longer  than  predicted  on  oritical  trials.  | 

Analysis  of  errors  was  performed  on  the  individual  aeleated  trial  types  ool-  j 

lapsed  across  segments.  FTE  were  more  frequent  on  trials  immediately  following  J 

i 

crltioal  trials  and  lees  frequent  on  the  second  trial  following  oritloal  trials.  | 
These  FTE  inoluded  only  anticipatory  return  responses.  Decision  errors  were  wlev-  j 
ated  on  the  oritloal  trlale  and  to  a  lesser  extent  on  the  trial  immediately  preoeeding" 
it  (see  figure  14).  j 

It  ie  apparent  from  these  data  that  alterations  in  blink  parameters,  i 
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Figura  12.  TiiM-looking  of  Blinks.  Th#  proportion  of  contingent  bllnke  which 
oooura  within  100  msec  of  the  identified  trial  event. 
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rigur«  14.  Error  rat «a  on  trial*  aurrounding  thoaa  trial*  on  whioh  a  long 
oloaurt  duration  blink  ocourrtd. 
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i.e.,  oloaure  duration,  la  aaaoolatad  with  alteration*  In  parforoanoa  ade¬ 
quacy, 

E,  Related  effort a  and  atudiaa, 

Coincident  with  the  above  described  experimental  work,  we  puraued  aoft- 
ware  and  eyitem  developement  for  atudy  of  aaocadlo  cyemovementa.  Our  eaooade  * 
identification  program,  whioh  had  exlated  aa  a  atand-alone  routine,  haa  been 
rewritten  to  interface  with  the  off-line  reduction  program.  Horlaontal  E00 
oan  be  input  aa  a  fourth  data  ohannel.  Saooadea  are  identified  and  varloue 
parametera,  duration,  amplitude,  peak  velocity,  eta.,  abetraoted  for  eaoh. 

Thlo  data  oan  be  printed  out  and/or  atored  on  diak  for  further  analyaia. 
Additional  analyale  and  plotting  programe  have  been  written  to  abatraot  and 
dlaplay  in  detail  the  aaooade  amplitude-velocity  relatlonahlp. 

We  alao  conducted  a  feaaibility  atudy  to  aaaeaa  the  potential  utility 
of  ualng  a  microcomputer  aa  a  portable  real-time  ayatem  for  field  uae  involving 
ooulomoter  meaaurea.  A  aummary  of  that  atudy  ie  inoluded  aa  Appendix  B.  We 
have  initiated  the  developement  of  a  prototype  eyatem  and  aoftwara  develope¬ 
ment  la  in  progreaa. 

XV,  SUMMARY 

In  the  oourae  of  the  oontreot  year  an  experimental  taak  aulted  to 
the  atudy  of  workload  factor a  in  the  preaent  oontext  haa  been  developed. 
Xyehllnk  oloaure  duration  waa  ahown  to  vary  in  parallel  with  meaaurea  of 
performance.  In  particular,  performance  on  triala  immediately  around  triala 
on  whioh  long  oloaure  duration  blink*  ooourred  demonatrated  variation*  in 
performance,  The  ooulomoter  meaaurea  examined  effectively  reflected  both 
tonic  and  phaalo  alteration*  in  atate . 
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You  are  to  do  the  following  task: 

Letters  will  appear  in  the  middle  of  this  aoreen  one  at  a  time*  You  are  to  compare  each 
letter  to  tho  one  last  aeen  and  make  a  decision.  The  letters  can  be  oompared  in  several 
ways.  For  this  task  you  nre  to  compare  the  letters  by  pass.  Some  are  small  (lower  ease) 
letter* i  some  are  eapitala  (upper  ease). 
pot  it  is  the  same  ease  as  the  last  letter  you  saw. , 

So,  for  example,  a  lower  ease  "g"  following  a  lower  oase  "a"  would  be  judged  "same 
ease".  A  eapital  »R"  following  the  small  "g"  would  be  judged  "different  ease",  and 
so  on  for  enoh  letter  presented. 

You  will  reoord  each  decision  with  your  index  finger  on  this  touch  panel. 

The  bottom  square  is  "home".,  Your  finger  rests  there  between  responses. 

You  do  not  respond  to  the  first  letter  presented  in  a  series,  because  you  do  not  yet  have 
a  letter  with  whioh  to  oompare  it.  For  eaoh  letter  after  that,  you  respond  in  the 
following  wayl 

If  the  letter  is  the  same  case  as  the  last  letter  you  saw,  quiokly  move  your  finger  to  the 
too  right  square.  Leave  your  finger  there  until  the  letter  goes  off  the  aoreen.  Then 
move  it  book  to  "home"  as  quickly  as  you  can  and  watoh  for  the  next  letter. 

If  the  letter  is  not  the  same  case  as  the  last  letter  you  saw,  touoh  the  too  left  enuare. 

When  the  letter  goes  off,  return  "horns"  quickly  and  watoh  for  the  next  letter. 

Remember i 

Right l  eame  case 
Left i  different  oase 

Hold  finger  on  your  response  until  the  letter  goes  off j  then  return  "home". 

Try  to  move  with  accuraoy  and  speed. 

(Any  questions?  ....  Here  are  some  praetioe  trials!  ....) 


H'ts-e..,.  . 
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TASK  INSTRUCTIONS i  SEQUENCE 
/Tou  art  to  do  tht  following  task: 

Lttttra  will  appear  in  the  middle  of  this  screen  one  at  a  time.  You  are  to  oompure  each 
letter  to  the  one  last  seen  and  make  a  decision.  The  letters  con  be  compered  in  several 
ways.  For  this  task  you  are  to  eompare  the  lotters  by  alphabetical  order  (sequence).  The 
letters  will  be  presented  either  i^i  sequence  or  out  of  sequence*  You  nre  to  decide  for  esc 
letter  whether  or  not  it  follows^  alphabetical  secucnoe  the  laet  letter  you  eaw. 

So,  for  example,  "B"  following  "A"  would  be  judged  "in  sequenoe"*  An  "S"  following  the 
"B"  would  be  judged  "out  of  sequence",  and  so  on  for  each  letter  presented.  (When  "A" 
follows  "2"  consider  it  "in  sequence"*)  .* 


You  will  record  each  decision  with  your  index  finger  on  this  touch  panel* 

The  bottom  square  is  "home"*  Your  finger  rests  there  between  responses* 

You  do  not  respond  to  the  first  letter  presented  in  a  series  beoause  you  do  not  yet  have 
a  letter  with  whioh  to  oompare  it*  For  each  letter  after  that,  you  respond  in  the 
’  following  wayt 

If  the  letter  is  in  alphabetical  seauenoe  with  the  last  letter  you  saw,  quiokly  move  your 
finger  to  the  ton  right  square.  Leave  you  finger  there  until  the  letter  goes  off  the 

e 

soreen*  Then  move  it  back  "home"  as  quiokly  as  you  ean  and  watoh  for  the  next  letter* 
If  the  letter  is  not  in  alphabetical  seauenoe  with  the  last  letter  you  saw,  touoh  the 
too  left  square.  When  the  letter  goes  off,  return  "home"  quiokly  and  watoh  for  the 
next  lotter. 

Remember  i  .■ 

next 

Right in  sequenoe 
Left i  out  of  eequence 

Hold  your  finger  on  your  response  Until  the  letter  goes  off|  then  return  "home". 

Try  to  move  with  accuracy  nnd  speed. 

(Any  questions?  .  Here  are  some  praotiee  trials!  ...»  ) 


1  h  .  .. 
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Introduction  to  the  Design  Approach 
of  a  Microcomputer-Based  System 

Introduction  '* 

Designing  a  microprocessor/microcomputer-based  Instrument  Is  a 
complex  task.  The  des4gner  Is  faced  with  a  multitude  of  alternatives 
from  which  a  "bast"  choice  may  not  be  easily  definable.  I  will  attempt 
to  delineate  these  alternatives  Into  three  basic  categor1es«  however, 
there  are  many  design  approaches  which  do  not  properly  fit  Into  these 
categories.  The  discission  will  be  primarily  from  a  research,  as  opposed 

to  an  Industrial,  point  of  view. 

» 

The  first  thing  a  laboratory  or  research  group  must  do  Is  to  define 
their  Intended  extent  of  Involvement  In  the  microcomputer  world.  The 
range  on  Involvement  might  be  one-half  a  man-year  and  up.  It  would  be 
unrealistic  to  expect  to  Incorporate  a  workable  microcomputer  Into  a 
research  project  In  less  than  six  months,  and  this  would  only  be  possible 
using  a  limited  variety  of  general  purpose  systems.  On  the  other  hand, 
there  may  be  no  foreseeable  upper  bound  on  Involvement.  In  fact,  what  might 
start  out  as  a  year's  commitment  could  evolve  Into  a  major  continuing  . 

* 

research  Involvement.  Oust  as  easily,  however,  what  starts  out  as  a  multi¬ 
year  effort  could  end  up  falling  flat  on  Its  face  without  the  proper 
Insight.  The  discussion  which  follows  wilt  hopefully  add  some  light  to 

the  subject  and  point  out  the  major  tradeoffs  between  three  design 

•  * 

approaches. 
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Three  microcomputer  (uC)  dill on  approaches 

A.  Tht  general  purpose  uC  system. 

A  general  purpost  uC  systtm  It  a  self-contained,  fully  optratlonal 

i 

computer,  bastd  around  a  specific  mlcroproctssor  (uP).  Examples  of  such 
systems  would  be  the  TRS-80,  Apple,  PET,  and  f  host  of  others,  generally 
available  off-the-shelf  at  many  locations.  They  are  designed  to  run 
programs,  usually  In  BASIC,  but  often  have  the  ability  to  be  programmed 
In  the  particular  uP's  machine  bode?  Many  of  these  systems  have  very 
Inexpensive  software  packages  Including  sueh  useful  utilities  as  an 
edltor/assemblar  or  disk  operating  system  (DOS).  A  general  purpose 
system  possesses  very  similar  qualities  to  a  mini-computer  but  Is  gener¬ 
ally  slower  end  has  less  mass  storage  capacity. 

Although  there  may  be  other  options  available,  these  general  purpose 
systems  usually  come  with  a  standard  keyboard  and  video  terminal  or 
television  Interface.  This  limits  Input/output  (I/O)  capabilities  In 
their  off-the-shelf  configuration,  but  with  a  variety  of  widely  available 
Interfaces,  they  can  gain  most  of  the  power  of  a  minicomputer.  A  general 
purpose  system  usually  comes  with  a  slow,  analog  quality  tape  storage 

a 

system  which  may  suffice  In  many  applications.  Floppy  disk  systems  are 
generally  available  and  can  make  program  development  considerably  easier. 
Finally,  a  very  useful  peripheral  Is  a  line  printer  which  .can  be.  simply 
connected  to  and  operated  by  the  general  purpose  ue  system. 

*  i  • 

B.  .The  dedicated  function  uC  system  or  single  boerd  computer  (SBC). 

The  approach  taken  with  an  SBC  Is  that  of  minimal  hardware  investment 

i 


ft.  , 

y  *  ■'  ' 
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and  of  dadlcatad  computer  operation.  If  an  Instrument  la  dailrad  to  bo 
small,  portabla,  and  Intelligent,  an  SBC  might  ba  a  good  approach.  An 
SBC  can  ba  burled  Inslda  of  an  Instrument  and. can  operate  as  Its  brains. 
Once  built,  though,  It  Is  usually  restricted  to  performing  Its  one 
appointed  task  forever.  A  general  purpose  uc  system  cannot  often  be  used 
for  these  applications  because  an  Instrument  cannot  be  built  up  around 
them. 

SBC's  consist  of  a  printed  circuit  board  (PCB)  and  all  components 
neatly  laid  out  and  soldered  onto  the  PCB.  There  are  a  wide  variety  of 
components  available  on  SBCs,  performing  different  functions,  but  they 
all  [lave  the  following  mlnlmums:  uP,  system  clock,  RAM,  ROM  or  ROM  space, 
and  some  type  of  1/0.  They  may  also  have  any  or  all  of  the  following: 
real  time  clock,  monitor  In  ROM,  video  or  printer  Interface,  analog  Input 
or  output  modules,  or  on-board  keypads  or  alphanumeric  displays.  There 
Is  very  little  standardization  In  the  computer  Industry,  specifying  what 
components  an  SBC  must  have  or  what  It  must  do.  Therefore  extreme  caution 
must  be  exhibited  In  selecting  an  SBC. 

It  Is  Important  to  understand  that  an  SBC  usually  has  no  Innate 
Intelligence.  All  of  Its  smarts  must  come  from  the  user.  These  computers 
are  designed  to  run  programs  usually  In  machine  language,  which  must  be 
designed,  written,  tested  and  debugged  by  the  user.  These  tasks  may  not 
be  at  all  easy  to  accomplish  with  the  SBC  alone.  The  SBC  should  be 

i  • 

thought  of  primarily  as  the  target  of  the  completed  software  and  not  so 
much  as  a  tool  for  software  development. 


•  * 
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C.  The  maximum  efficiency  uC  system. 

Designing  a  maximum  efficiency  uC  system  requires  probably  the 
largest  Initial  expenditure  of  funds  but  Is  the  most  versatile  approach 
of  the  three. 

What  Is  meant  by  maximum  efficiency  Is  a  computer  which  Is  specially 
designed,  chip  by  chip,  to  have  exactly  the  necessary  components  and  no  . 
others.  This  can  usually  only  bq  accomplished  In  a  custom  design. 

In  order  to  be  successful  In  this  "from  scratch"  approach,  a  micro¬ 
processor  development  system  <MDS)  becomes  a  necessity.  An  MDS  Is  basically 
a  software  support  device  which  enables  one  to  develop  programs  to  run  on 
a  uP- based  Instrument  or  computer.  It  allows  about  as  much  versatility 
as  Ip  possible  for  writing,  assembling,  testing,  debugging,  and  storing 
programs  during  development.  One  must  keep  In  mind  that  It  Is  a  software 
tool  and  will  not  solve  all  the  hardware  problems  associated  with  designing 
a  custom  uc  board.  For  hardware  problems  there  are  such  things  as  logic 
probes,  logic  analysers,  and  oscilloscopes. 

An  MOS  Is  usually  specific  to  a  uP  which  means  that  the  purchase  of 
an  MDS  may  well  restrict  use  to  that  same  uP  In  future  projects.  If  the 
choice  Is  made  wisely  this  should  not  cause  a  problem,  because  manufacturers 
are  beginning  to  realize  that  they  must  support  all  of  the  uP  they  are 
selling.  Some  uP  have  looked  promising  at  their  conception  but  have 
subsequently  faded  awayi  however,  there  are  some  Industry  standards  which 
will  almost  certainly  be  around  for  quite  some  time  to  come,  with  growing 

i  t 

support.  For  Instance,  the  Industry  leader,  Intel,  has  on  the  order  of 
one-half  of  the  uP  market  with  Its  two  main  uP  families,  the  8080  and  the 
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8086,  8  and  16  bit  processors,  respectively.  One  can  be  reasonably 
assured  that  they  will  both  be  long-lived.  Motorola  Is  strongly  supporting 
universities  with  the  hopes  of  raising  the  next  generation  of  engineers 
and  computer  scientists  with  their  crop  of  uP  products. 

At  any  rate  the  Investment  In  an  MDS  may  be  a  very  wise  one  If  the 
Involvement  In  uC  field  Is  judged  to  be  a  long  one. 

Choices  and  tradeoffs  of  the  three  approaches 

Based  upon  the  Initial  discussion  and  the  existence  of  One  Thousand  . 
Dollars  ($1,000.00),  a  general  purpose  system  should  be  strongly  considered 
as  a  starting  point.  It  allows  for  easy  training  of  personnel  and  supports 
simple  "add-ons".  All  of  the  engineering  has  been  done  and  a  researcher 
can  benefit  from  the  advantage  of  hobby  market  pricing— a  rather  rare 
phenomenon  In  research.  Programming  can  be  done  In  BASIC  and  combined  with 
or  replaced  by  machine  language  at  the  user's  pace.  With  the  existence  of 
real-time  clocks,  and  versatile  analog  1/0  modules,  a  general  purpose 
system  can  be  surprisingly  powerful. 

There  may,  however,  be  things  that  are  simply  not  possible  with  a 
general  purpose  system.  It  Is  not  Intended  to  be  built  Into  a  dedicated 
device.  It  Is  not  Intended  to  be  portable  (on  a  day-to-day  basis).  It 
may  not  have  exactly  the  right  peripheral  or  "attachment".  In  these  cases 
an  SBC  or  custom-designed  board  might  be  In  order.  Keep  In  mind,  however, 

that  an  SBC  may  not  have  Its  own  monitor  and  Is  not  programmed  In  BASIC, 

«  •  * 

and  that  a  custom  board  will  not  have  numerous  available  Interface  boards 
and  peripherals.  A  custom  board  will  require  custom  Interfaces. 
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Consider  uC  development  costs.  A  general  purpose  system  will 
probably  eost  upwards  of  One  Thousand  Dollars  ($1,000.00).  This  cost  may 
be  a  significant  percentage  of  the  total  development  cost  because  the 
system  requires  no  tinkering.  It  can  be  brought  Into  the  lab,  plugged  . 

In,  and  running  programs  In  an  hour. 

With  an  SBC  some  means  for,  developing  programs  becomes  necessary. 

The  minimum  requirement  Is  to'  have  an  on-board  monitor  which  allows  load¬ 
ing  and  changing  memory  locations  and  executing  programs.  Programming  this 
way  Is  a  terribly  tedious  process  and  produces  dubious  results.  Even 
with  a  fully  operational  program,  the  SBC  must  have  the  appropriate  I/O 
capabilities  to  carry  on  some  meaningful  task.  An  SBC,  therefore,  will 
require  many  times  the  development  effort  and  cost  of  a  general -purpose 
system.  SBC  themselves  can  range  In  cost  from  $100  to  $1,000,  or  more, 
depending  on  their  performance  characteristics. 

* 

If  on  the  order  of  Three  Thousand  Dollars  ($3,000.00)  were  available 
for  equipment,  an  MDS  In  conjunction  with  a  hand-picked  (MDS-compatlble) 

SBC  might  be  used.  The  SBC  could  supply  the  engineered  and  tested, 
appropriately  configured  components  and  the  MDS  could  provide  the  necessary 
software  support.  The  result  would  be  a  workable  combination  of  hardware 
and  software  ending  In  a  dedicated  operational  SBC  and  a  free  MDS  ready 
to  take  on  the  next  project.  The  total  cost  would  be  the  sum  of  the  SBC, 
a  prorated  percent  of  the  MOS,  end  X  number  of  man-hour  dollars.  In  the 
long  run  this  Is  an  extremely  versatile  and  reasonably  cost-effective 
approach.  It  should  be  prefaced,  however,  with  some  experienced  staff  or 
flexible  deadlines. 


__ 
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Summary  and  recomnendatloni 


Otcldlng  how  much  to  Invest  In  a  uC  system  Is  dependent  on  Interest, 
present  experience,  requirements,  and  time  constraints.  Relative  costs 
Must  be  placed  on  initial  Investments,  development  time,  and  versatility. 

The  areas  of  software  and  hardware  support  must  be  carefully  consid¬ 
ered.  Either  a  general  purpose  system  or  an  MDS  with  an  SBC,  alleviate 
most  of  the  hardware  problems  and  let  the  user  tackle  only  the  software. 
Developing  a  uC  system  with  an  MDS  or  SBC  alone  requires  expertise  In 
both  hardware  and  software. 

,My  recommendation  would  be  as  follows. 

For  a  laboratory  with  little  or  no  experience  with  uCs  or  uP's,  a 

general  purpose  system  should  be  examined  carefully  for  Its  abilities 

and  limitations.  If  the  project  requirements  are  clear  and  the  general 

purpose  system  is  adequate,  then  It  should  be  utilized.  If  the  uC  Is  to 

be  used  In  a  dedicated  environment,  then  an  SBC  may  be  the  mosfapproprlate 

choice.  Software  development  will  become  the  primary  problem  and  some  other 

support  equipment  may  be  necessary  for  this.  An  SBC  with  an  on-board 

monitor  would  be  a  minimum  requirement.  If  a  custom  design  was  absolutely 
« 

necessary,  then  an  MDS  might  be  required  for  extensive  software  support. 

The  MDS  alone,  however,  would  probably  not  bo  sufficient  for  tackling  all 
the  hardware  problems  as  well.  The  custom  design  approach  Is  the  most  comp¬ 
licated  of  the  three  and  raqulres  a  good  deal, of  time  and  experience. 


